Papers with low-level scene understanding
WikiVideo: Article Generation from Multiple Videos (2026.findings-acl)
Copied to clipboard
Alexander Martin, Reno Kriz, William Gantt Walden, Kate Sanders, Hannah Recknor, Eugene Yang, Francis Ferraro, Benjamin Van Durme
| Challenge: | Existing methods for retrieval-augmented generation focus on text rather than video. |
| Approach: | They propose a benchmark to generate Wikipedia-style articles from multiple videos . they propose 'collaborative article generation' that leverages an r1-style reasoning model and a VideoLLM to draw higher-level inferences about the target event than is possible with VideoLLms alone. |
| Outcome: | The proposed method outperforms existing methods in oracle retrieval and RAG settings while suggesting promising avenues for future work. |